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Abstract 

An algebraic multigrid method is proposed to solve eigenvalue problems 
based on the combination of the multilevel correction scheme and the alge¬ 
braic multigrid method for linear equations. The algebraic multigrid method 
setup procedure is applied to construct the hierarchy and the intergrid transfer 
operators. In the algebraic multigrid scheme, a large scale eigenvalue problem 
can be solved by some algebraic multigrid smoothing steps in the hierarchy 
and some eigenvalue problems solving in a very small dimension. Some nu¬ 
merical experiments are presented to validate the efficiency of the proposed 
algorithm. 
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1 Introduction 

Algebraic multigrid (AMG) method was introduced first in [2], where the main idea 
is to design a similar multigrid method for matrices. However, since there is no geo¬ 
metric background, the convergence has been proved only for some special matrices, 
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such as symmetric positive definite M-matrices with weak diagonal dominance [18] 
and without the assumption of M-matrices in [11, 16]. The essential difficulties for 
AMG method lie in the choice of coarse grid and intergrid transfer operators, which 
fully depend on our understanding of algebraic smooth error under certain smooth¬ 
ing processes. The classical coarsening strategy was introduced in [18], and others 
like aggregation and smooth aggregation in [17, 20], compatible relaxation [4, 14], 
based on element interpolation [5], energy-based strategy [3] and so on. The paper 
[8] presents some numerical experiments to study the robustness and scalability of 
the AMG method. Parallel and adaptive AMG methods have also been studied in 
[6, 10]. Due to its simplicity, the AMG method has been applied to many problems, 
such as [1, 9, 15], etc. 

In this paper, we are interested in the generalized eigenvalue problem; Find 
(A, n) G M X R"' such that u^Mu = 1 and 

Au = \Mu, (1.1) 

where A and M are real, symmetric N x N matrix, and n is a vector in R"'. The con¬ 
cerned generalized eigenvalue problem (1.1) always aries from the discretization of 
the elliptic partial differential equations involved in several scientific and theoretical 
fields such as material sciences, electromagnetics, quantum chemistry, acoustic, etc. 
These important applications usually require high resolution which means the dis¬ 
cretization results in large scale algebraic eigenvalue problems. Then it is very useful 
to design efficient eigensolvers which need nearly optimal computational complexity. 

It is a natural idea to use the AMG method for eigenvalue problems. A very 
good review of the application of AMG method to eigenvalue problems is given in 
[12] and references cited therein. Roughly speaking, in the normal strategies, the 
AMG method is adopted as the smoother for linear equations in the inner iteration 
combined with some types of outer iterations for eigenvalue problems such as inverse 
power, shift-and-inverse, Rayleigh-quotient, locally optimal block preconditioned 
conjugate gradient and so on. Recently, a type of multilevel correction method is 
proposed to solve eigenvalue problems in [13, 21, 22]. In this multilevel correction 
scheme, the solution of eigenvalue problem on the final level mesh can be reduced to 
a series of solutions of standard boundary value problems on the multilevel meshes 
and a series of solutions of the eigenvalue problem on the coarsest mesh. Therefore, 
the computational work and required memory can arrive at the optimality. Similarly 
to the AMG method for boundary value problems, we can also design a type of AMG 
method for eigenvalue problems based on the multilevel correction method. The aim 
of this paper is to present an AMG method for eigenvalue problems (1.1). 

The rest of this paper is organized as follows. In the next section, we introduce 
the classical AMG method, mainly the constructing of “coarse-grid”. An AMG 
algorithm for solving the eigenvalue problem is presented and analyzed in Section 
3. In Section 4, some numerical tests are presented to validate the efficiency of the 
proposed algorithm. Some concluding remarks are given in the last section. 
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2 Classical AMG 


This section is devoted to introducing the classical AMG method which aims at 
solving the ill-conditioned linear system Au = f similar to geometric multigrid 
(GMG) method. Since there is no true geometric background, the main content 
is to determine the “coarse-grid” and intergrid transfer operators directly from the 
matrix A. By analogy, we define grid points, G, as the indices {1,2, ••• ,N} of 
u = and choose a subset of G as the coarse grid points according 

to the undirected adjacency graph of the matrix A. 

Denote C as the coarse grid points and F := Q\C the fine points. For any vector 
in the coarse grid, Vc, the interpolation (prolongation) operator to fine grid can be 
defined as follows: 


(dc^c)i 


{vc)i Hi eC, 

ifieF, 


( 2 . 1 ) 


where Ci is some small sets of interpolation points Ci C C. 

Following [18, 19], we define the strong dependent set Fj := {j||apj > 6^ max^^j |ai^|} 
and the strong influence set Sf := {j\i G Sj} with 0 < 9 < 1 (usually 0.25). Then 
the coarsening process goes as the follows: 


Algorithm 2.1. Preliminary C-point choice: 


1. Set C = (/), F = (l},U = fl and qt = {Sfl for all i. 

2. Pick an i & U with maximal A*. Set C = C U {*} and U = G\{i}. 

3. For all j G Sf G U, 

(a) Set F = F{J {j} and U = U\{j}. 

(b) For all i G Sj f] U, set + 1. 

4- For all j E Si D U, set qj = qj — 1. 

5. IfU = 0, stop. Otherwise, go to Step 2. 

Algorithm 2.2. Final C-point choice and definition of interpolation weights: 


1. SetT = th. 

2. IfTf2 F, stop. Otherwise, pick i G F\T and T = T U {i}. 

3. Set Ci = Sin C, Df = Si\Ci, Df = Ni\Si and Ci = 0. 

4 . Set di — an -1- ^ ^ij and for k G Ci, set dj^ — 

5. For each j G 
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(a) If Sj n Cj 7 ^ 0, then go to (c). 

(b) If Ci 7 ^ 0, set C = C U {i}, F = F\{i}, and go to Step 2. Otherwise, set 
Ci = {j}, Ci = CiO {j}, Df = Dl\{j}, and go to Step f. 

(c) Set dk — djf “1“ ttijOjk! Oiji for k G Ci. 

6 . Set C = CUCi, F = F\Ci, and Wik = —dk/di for each k G Ci, and go to Step 

2 . 

Denote Ai = A, Mi = M and the finest grid Di = D. Based on Ai, the AMG 
setnp procednre builds up the prolongation and restriction operators I^^i and I^^^ = 
respectively for fc = 1, 2, • • • , n — 1. The coarse matrices are defined with 
the Galerkin projection as follows: 

Afc+i = and Mfc+i = 4^+'Mfc4\„ for fc = 1, 2, • • • , n - 1. (2.2) 

We use di, • • • , 4 to denote the dimension in each level grid Di, • • • , Gn- 


3 AMG algorithm for eigenvalue problem 


In this section, we introduce an AMG method for solving eigenvalue problems. Simi¬ 
larly to the geometric case in [21], assume we have obtained eigenpair approximations 
{I<k’^\uk’^"'}'j=i to our desired eigenpairs. Now we introduce an AMG correction step 
to improve their accuracy. 

Algorithm 3.1. AMG Correction Step 


1. For j = 1, • • • , g Do 

Solve the following linear eguation by m AMG-iterations 




UD 


,00 


(3.1) 


Perform m AMG iteration steps with the initial value to obtain a new 
eigenfunction approximation which is denoted by 


u 


OT+i) 


= AMG{k, m). 


where k denotes the working level Qk for the AMG iteration, leads to 

the right hand side term of the linear eguation, denotes the initial guess 
and m is the number of AMG iteration times. 

2. Set Vk/+i = • • • , construct two matrices and 

as follows 


A 


d+i) _ 


n.k 


A, 






(3.2) 


4 


and 


M, 


(£+1) 


n,fc 


M, 

^k,e+l^kln Vk/+lMkVk/+l J 

Solve the following eigenvalue problem: Find such that 


n IkMkVk/+l 


(3.3) 


/l(^+i)™(ii^+i)_ \ O’l^+i)/\/f(^+i)™0’>^+i) 

u — '^u k 


^n,k "^k 


(3.4) 


For j = 1, ■ ■ ■ ,q Do: 
Set 


„,0’i^+l) _ rk ij,i+l) 
“fc ~ ^n-kk 


(1 : dn) + Vk^i+iX^l' \dn + 1 : ci„ + g). 


End Do 

Summarize above two steps by defining 

^ AMGCorrection{n, k, {Xk’^\'>^k’^'^}'j=i)- 

Based on the above algorithm, we can construct an AMG method for eigenvalue 
problem which is a combination of the nested technique and the AMG correction 
step dehned by Algorithm 3.1. 

Algorithm 3.2. AMG Eigenvalue Problem 

1. Solve the following low dimensional eigenvalue problem in the ni-th grid 
(ni < n): Find {Xnl^Un}) such that {unlyM^^Un} = 1 and 

An.uli! = (3.5) 

Solve this eigenvalue problem to get eigenpair approximations {Ant }i = l 

which are approximations to our desired eigenpairs. 

2. For k = Hi — 1, ■■ ■ ,1, perform the following correction steps 

• Set = Agi and = 4\i4+i forj = l,---, Q- 

• Do the following correction iteration for i = 0, - ■ ■ ,pk — 1 

^ AMGGorrection{n, k, {Xl^’^\ 

• Set A^^^ = and for j = 1, • • • , g. 

End Do 

Finally, we obtain eigenpair approximations {X^i^^^\ui’^^^'^Yj=i ^he finest level 
grid fli. 
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Different from the GMG method [21], we do not have the exact prolongation 
and restriction operators. In the practical computation, we can choose the suitable 
iteration times pk to meet the accuracy requirement. Compared to other AMG 
methods, the proposed method here only need to do smoothing iterations for the 
standard elliptic type of linear equations and the AMG method can act as a block- 
box. Furthermore, the required memory for the eigenpair solving is only about qN 
and we can also compute effectively eigenvalues in a given interval in the middle of 
the spectrum. Inspired by the analysis for the GMG method [21], it is known that 
the AMG method can have very good convergence rate if the coarse grids capture 
the low frequency information of the hnest grid well. 


4 Numerical examples 

In this section, two numerical examples are presented to illustrate the efficiency of 
the AMG method proposed in this paper. 

4.1 Model eigenvalue problem 

Here we give numerical results of the AMG method defined by Algorithm 3.2 for 
the model eigenvalue problem: Find (A,m) such that 

{ —Am = Am, in D, 

M = 0, on dVL, (4.1) 

/^M^dD = 1, 

where D = (0,1) x (0,1). The stiff and mass matrices A and M in problem (1.1) 
are obtained by discretizing problem (4.1) with the linear finite element method [7]. 

In order to show difference of the AMG method from the GMG method, we 
generate the mesh by Delaunay method which has no the hierarchy structure. In 
this example, we use two meshes: the coarse one with mesh size h = 0.01 and the 
hner one with mesh size h = 0.005. 

Algorithm 3.2 is applied to solve the algebraic eigenvalue problem (1.1) derived 
from the discretization of (4.1). In this subsection, we choose m = 2 and 2 conjugate 
gradient smoothing steps for the presmoothing and postsmoothing in each AMG 
iteration step in Algorithm 3.1. In the k-th level {k = 1, • • ■ , ni — 1) grid of the 
AMG scheme dehned in Algorithm 3.2, we only do pk AMG correction steps dehned 
in Algorithm 3.1. In order to measure the algebraic error of the AMG method, we 
also solve the eigenvalue problem by the direct method. 

Figure 1 gives the numerical results (algebraic errors) for the first 13 eigenvalues 
A = [2, 5, 5, 8,10,10,13,13,17,17,18, 20, 20]7r^ 
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Figure 1: Problem (4.1): The algebraic errors of the AMG method for the first 
13 eigenvalues on the Delaunay mesh with h = 0.01 on the unit square, where P 
denotes the AMG correction steps in each level pk = P, Xj and A^*’’ denote the 
eigenvalue approximations by the AMG method and direct solver, respectively. The 
dimensions in each level of grids are Aoof = [17361,6689,2469,937,523,425] and 
ni = 5. 

on the coarse mesh with the mesh size h = 0.01 and Figure 2 gives the corresponding 
numerical results on the hner mesh with mesh size h = 0.005, respectively. From 
Figures 1 and 2, we can hnd that the AMG scheme exhibits the uniform convergence 
rate which is the same as the AMG iteration for boundary value problems. 

4.2 More general eigenvalue problem 

Here we give numerical results of the AMG method for solving a more general 
eigenvalue problem on the unit square domain D = (0,1) x (0,1): Find (A,m) such 
that 

{ —Am — = Am, in G, 

M = 0, on dQ, (4.2) 

f^u^dn = 1 , 

where Z = (0.5, 0.5). The stiff and mass matrices A and M in problem (1.1) are also 
obtained by discretizing problem (4.2) with the linear finite element method [7]. 

In this example, we also use two meshes (the coarse one with mesh size h = 0.01 
and the finer one with mesh size h = 0.005) generated by Delaunay method to 
investigate the convergence behaviors. 

Here, we also choose m = 2 and 2 conjugate gradient smoothing step in the 
presmoothing and postsmoothing procedure. Here we also compare the numerical 
results with the direct algorithm. Figure 3 gives the numerical results (algebraic 
error) for the hrst 13 eigenvalue approximations on the coarse mesh and Figure 
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Figure 2: Problem (4.1); The algebraic errors of the AMG method for the 
first 13 eigenvalues on the Delaunay mesh with h = 0.005 on the unit 
square, where P denotes the AMG correction steps in each level pk = P, Xj 
and denote the eigenvalue approximations by the AMG method and di¬ 
rect solver, respectively. The dimensions in each level of grids are A^oof = 
[69177, 26170, 9075, 2929,1252, 882, 814, 801] and ni = 6. 

4 gives the corresponding numerical result on the hner mesh. Figures 3 and 4 
also show the uniform convergence rates which means the AMG method defined by 
Algorithm 3.2 has good efficiency for solving eigenvalue problems. 


5 Concluding remarks 

In this paper, we present a type of AMG method to solve algebraic eigenvalue 
problems arising from the discretization of partial differential equations. The AMG 
setup procedure is applied to construct the hierarchy and the intergrid transfer 
operators of the algebraic problems. Based on the combination of the multilevel 
correction method and the AMG method for linear equations, an AMG method 
for eigenvalue problems is proposed. This type of AMG method need almost the 
optimal computational work and the least memory. Finally, the efficiency of the 
proposed AMG method is exhibited by two numerical examples which show that 
the AMG method has uniform convergence rate. The choices of parameters m and 
Pk, presmoothing and postsmoothing operators and AMG coarsening strategy should 
be considered and tested in future. 

















Figure 3: Problem (4.2): The algebraic errors of the AMG method for the first 
13 eigenvalues on the Delaunay mesh with h = 0.01 on the unit square, where P 
denotes the AMG correction steps in each level pk = P, Xj and A^*’’ denote the 
eigenvalue approximations by the AMG method and direct solver, respectively. The 
dimensions in each level of grids are Aoof = [17361,6689,2469,937,523,425] and 
ni = 5. 
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